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Abstract 


In  this  paper  we  show  that  the  M/M/c  queue,  with 
arrival  and  service  rates  which  vary  according  to  the 
state  of  a Markov  process,  has  a steady-state  probability 
vector  of  a modified  matrix-geometric  form.  The  rate 
matrix  R is  the  unique  positive  solution  to  a quadratic 
matrix  equation,  which  may  be  solved  numerically  by  suc- 
cessive substitutions.  A theorem  which  provides  an  accur- 
acy check  on  that  computation  is  proved. 

Finally  a numerical  excunple  is  discussed  and  its 
results  are  interpreted. 
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I.  Introduction 


This  paper  contains  generalizations  and  further 
elaborations  of  results  discussed  in  [1] . We  refer  to  this 
earlier  paper  for  all  definitions  and  notations.  The  main 
new  topics  of  discussion  are;  the  joint  stationary  proba- 
bility distribution  of  the  queue  length  and  the  underlying 
phase  state,  considered  at  epochs  where  the  phase  state 
changes;  the  extension  of  Theorem  5 of  [1]  to  the  M/M/c 
queue;  the  discussion  of  some  computational  aspects  and 
numerical  examples.  Throughout  this  paper,  we  shall  only 
consider  stable  versions  of  the  queues  under  discussion. 

Lemma  1 

Provided  that  < iri£,  the  positive  matrix  R,  which 
is  the  unique  solution  to  the  equation 

(1)  R^A(y)  + R[Q-A(X)-A(p) ] + A(A)  =0, 

in  the  set  of  nonnegative  matrices  of  spectral  radius  less 
than  one,  satisfies 

(2)  R u = X.- 
Proof 

The  matrix  R was  introduced  in  Theorem  5 of  [1].  B 
postmultiplying  (1)  by  e,  we  obtain 
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R^y  - R(^+y)  + X = (I-R) (^-Ru)  = 0. 

Since  the  spectral  radius  of  R is  less  than  one,  the  result 
follows . 

Remarks 

a.  The  equality  (2)  can  either  be  used  as  an  accuracy  check 
on  the  numerical  computation  of  R or  can  be  incorporated  into 
the  evaluation  of  R,  so  as  to  expedite  that  algorithm. 

b.  The  inner  product  ^Re  is  easily  seen  to  be  the  steady- 
state  probability  that  the  server  is  occupied.  It  should  be 
noted  that  in  general  this  quantity  is  not  equal  to 

p = (ti_X)  (Try)"*^.  In  pedagogical  material,  it  should  therefore 
be  stressed  that  the  interpretation  given  to  the  traffic 
intensity  is  strongly  model-dependent. 

An  exception  is  the  interesting  special  case,  where 


V = y*e.  In  that  case,  the  equality  p = ^Re  follows  readily  j 

from  (2) . 1 


II.  The  Queue  Length  at  Phase  Transitions 

The  motivation  for  considering  this  embedded  process 
is  of  some  interest.  As  noted  in  [ 1 ] , the  most  interesting 
cases  of  the  M/M/1  queue  in  a Markovian  environment  involve 
one  or  more  phases  j during  which  Xj  > Uj,  even  though  the 
global  queue  is  stcQsle.  The  realizations  of  such  queueing 
processes  exhibit  substantial  random  oscillations  which  are 
evident  in  their  effect  on  the  components  of  the  steady- 
state  vector  X of  Thm.  5 [ 1 ] . During  a sojourn  in  a phase 
j for  which  the  queue  is  "locally"  unstable,  substantial 
buildup  may  occur  to  be  cleared  during  later  phases  for  which 
the  queue  is  locally  stcJale. 

One  might  expect  to  obtain  useful  additional  informa- 
tion by  considering  the  queue  lengths  at  the  successive  phase 
transitions.  We  shall  derive  the  joint  stationary  probabil- 
ity density  of  the  queue  length  and  the  phase  immediately 
before  and  immediately  after  phase  transitions.  We  shall 
however  show  that  the  conditional  queue  length  density  at  the 
end  of  a sojourn  in  the  phase  j is  the  same  as  the  conditional 
queue  length  density,  given  that  the  phase  is  j . By  suitcible 


interpretation  of  a detailed  numerical  excunple  in  Section  IV, 
we  shall  see  that  this  result  is  due  to  the  exponential 
nature  of  the  sojourn  times  in  the  various  phases. 
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It  is  clear  that  the  sequence  { (Cj^,  ,n^0} , where 

is  the  queue  length  and  the  phase  state  immediately 
after  the  n-th  phase  transition,  is  a Markov  chain  on  the 
state  space  {(i,h):  iiO,  l^h^m).  We  denote  by  p^^i  (h,u) , 
the  probability  that  in  an  ordinary  M/M/1  queue  with  para- 
meters the  queue  length  at  time  u is  i',  given  that 

it  is  i at  time  0.  Explicit  formulas  for  p^^i (h,u)  are 
known,  but  will  not  be  needed  in  our  discussion.  The  transi- 
tion probability  matrix  P of  the  chain  nSn^'^n^  ^ then 
given  by 

(3)  Pjjj^,(i,i')  * /Pii,(h,u)e  duQ^h*/ 

0 

for  i>0,  i'>0,  h?^h',  l<h,  h'<m. 

* 0,  for  i>0,  i'^0,  h=h'. 

The  exponent  = -Qhh»  lihim.  We  shall  find  it 

convenient  to  partition  the  matrix  P into  m^m  blocks 
P(i,i')  = {Pjjh*  (if  i' ) ^ » which  we  write  as 

(4)  P(i,i')  = V(i,i' ) [Q+A (a) ] , for  i>0,  i'>0. 


where  A(£)  = diag  (a^^, . . . ,ajjj)  and  V(i,i') 


= diag 


CO 

/ p,  . , (h,u)e  du,  l<h 

10 


ihim^  . 


Theorem  1 

The  stationary  probability  vector  ^ = (^O'Zl'***^ 
of  P is  given  by 


w 
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(5)  = (ii^)“\(I-R)R^[Q+A(a)  ] , for  i>0. 


Proof 


The  steady-state  equations  2.  “ written  as 


(6)  Zi  = I 1 =w^[Q+A(ct)], 

i '=0 


for  iiO,  where  Wi  = ^ yj,V(i',i). 

i'=0 


Setting  y.  = u,  we  first  obtain  that 
i=0 


-1 

uA  (£) [Q+A (£) ]=u.  Also  ue=l,  since  ye=l.  It  readily  follows 
that  u = (iro)  "^ttA  (a)  , a result  which  is  to  be  expected. 


oo 

Setting  / p.,.(h,u)e  du  = p?, . (h) , for  l<him,  the 
0 1 3- 

birth-and-death  equations  for  the  M/M/1  queue  yield  in  a 
straightforward  manner  that 


(7)  ^°'h'‘'^h^  ^ Pi'l(^)»^h 

(Ch+^h'^i^h^  = «i.i  + Pi',i-l(h)Xh  + Pi' ,i+i^^^ ‘'h' 
for  i'iO,  i^l,  lihim. 


It  now  readily  follows  that 
(8)  V(i' ,0)  A(£+X)  = 6^,qI  + V(iM)A{£), 

V(i' ,i)  A(£+^+u)  = + V(i' ,i-l)  A (X) 

+ V(i' ,i+l) A(u) , 

for  i'>0,  i>l. 
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We  further  obtain  that 

\^A(a+^)  = = Wq[Q+A  (a)  ]+Wj^A  (£) 

WiA(o+X.+u)  = M +w^+l^  (li) 

= [Q+A  (£)  ] +Wj^_;LA  {X)  tW^+^A  (_u)  , 

, for  iiO. 

I 

I Upon  simplification,  we  notice  that  the  vectors 

, iiO,  satisfy  the  equations 

! 

(10)  ^[Q-A(X)]  tWj^ACji)  =0 

Wj^^^A  (M  + [Q-A  (£+ji)  ] + Wj^^.]^A  (£)  = 


Proof 

The  vectors  and  are  related  by 

(14)  ^(a)[Q+A(a)]  = i-0* 

Clearly  the  vectors  in  (13)  are  positive,  satisfy  the 
equations  (14)  and  ze=l . This  guarantees  that  z is  the 
steady-state  vector  of  the  Markov  chain,  obtained  by  con- 
sidering the  queue  length  and  phase  immediately  prior  to 
phase  transitions. 

Remark 

We  see  that 

(15)  “ (l£)  (ifjOj)  for  i>0,  l<j<m. 


so  that  the  conditional  probcibilities  that  there  are  i 
customers  in  the  queue,  given  that  the  phase  is  j and  given 
that  a sojourn  in  the  phase  j has  ended,  are  equal. 


t 

I' 


The  matrix  is  the  unique  solution  in  the  set  of  non~ 
negative  matrices  of  spectral  radius  less  than  one  of  the 


U-1^0  + = 0' 

are  satisfied,  provided  Xo'’**'?5c-l  properly  chosen. 


The  c initial  equations  are  equivalent  to 

, . . . T = £. 
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Since  T is  clearly  irreducible,  it  suffices  to  verify  that 
T is  semi-stable.  The  off-diagonal  elements  of  T are  clearly 
nonnegative.  Moreover  we  have 

^c-1,0^  ^c-1,1-  ^c^O-  ~ ^c^O-  ~ ^c-1,2- 

= ~ h.  ~ 9.' 

It  follows  that  the  diagonal  elements  of  T are  negative  and 
hence  that  T is  semi-stable.  The  normalizing  condition  (19) 
uniquely  determines  0ii<c. 

Remark 

It  is  evident  that  the  proof  does  not  depend  on  the 
explicit  form  of  the  cm^cm  upper  left  hand  corner  of  Q*  (c) , 
but  only  on  the  irreducibility  of  T.  Any  variations  of  the 
present  model  which  modify  only  the  upper  left  hand  corner 
will  therefore  have  a steady-state  vector  of  the  same  general 
type. 


IV.  A Numerical  Example  (c=l) 


In  order  to  illustrate  the  behavior  of  a queue  in 
which  short  periods  of  gross  instability  alternate  with 
long  periods  of  highly  under saturated  conditions,  we  con- 
sider an  example  where  Q is  given  by  the  8x8  matrix 


and  the  vectors  ^ and  ^ are  given  by 


X = (40,  5,  2,  1,  1,  1,  1,  1) , 

W = (10,  5,  5,  3,  3,  3,  3,  3)  . 

The  vector  is  given  by 

£ = ^(1.  4,  4,  4,  4,  4,  4,  4)  , 
and  P = (£^)  (T|_w)~^  = 0.8. 

-1  7 -1 

The  equation  R = -A2Aj^  -R  AqA^  , was  solved  by 
successive  substitutions , which  were  continued  until  the 
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meiximum  entry-wise  difference  between  iterates  was  less  than 
10~®.  This  took  989  iterations.  The  vector  was  evaluated 
and  it  was  found  that  < 10”®e,  with  the  largest  differ- 

ence occurring  in  the  large  first  component. 


A small  improvement  in  accuracy  can  be  obtained  with 
little  additional  effort.  Let  R"lR'  be  the  last  two  iterates 
computed , then  we  compute  the  matrix  R by  R j j i j j i + 

0 j (Rj j , -Rj j , ) , where  the  quantities  Oj  are  chosen  so  that 
R^  = 

The  conditional  means  and  variances  of  the  queue 


lengths  in  the  various  phases  were  computed  next  and  are 
listed  below. 

Table  1:  Conditional  Means  and  Variances  in 


Phase 

the  Various  Phases 

Mean 

Variance 

1 

50.65 

2575.55 

2 

50.98 

2581.12 

3 

41.55 

2482.10 

4 

— - 36.05 

2346.10 

5 

31.29 

2178.66 

6 

27.17 

1996.99 

7 

23.60 

1812.20 

8 

20.50 

1631.56 

Selected  percentiles  of  the  conditional  distributions 
exhibit  very  clearly  the  varicdjility  of  the  queue  length  over 
the  various  phases. 
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Table_2:  Deciles  of  the  Conditional  Queue  Length  Distribution 


(the 

first 

index  for 

which 

k%  is  exceeded) 

_% 

Phase 

1 Phase  2 

Phase 

3 Phase 

4 Phase  5 

Phase  6 

Phase  7 

Phase 

10 

5 

5 

0 

20 

11 

11 

2 

0 

0 

30 

18 

18 

8 

2 

1 

0 

0 

40 

26 

26 

16 

8 

2 

1 

1 

0 

50 

35 

35 

25 

18 

10 

4 

2 

1 

60 

46 

47 

36 

29 

22 

14 

7 

2 

70 

61 

61 

51 

44 

36 

29 

22 

14 

80 

82 

82 

71 

64 

57 

50 

42 

35 

90 

117 

117 

107 

99 

92 

85 

77 

70 

95 

152 

152 

142 

134 

127 

120 

113 

105 

99 

234 

234 

223 

216 

209 

202 

194 

185 

Table  3;  Conditional  Probabilities  of  Emptiness  in  the  Various 
Phases 


Phase 


Probability  of  Emptiness 


1 

2 

3 

4 

5 

6 

7 

8 


0.0142 

0.0168 

0.1284 

0.2079 

0.2701 

0.3233 

0.3692 

0.4090 
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Interpretation 


The  numerical  results  for  this  exeunple  exhibit  a 
number  of  qualitative  features,  which  deserve  to  be  stressed 
and  interpreted  as  they  are  not  present  in  more  elementary 
queueing  models. 

a.  The  global  mean  queue  length  is  given  by 
jr(I-R)~^Re  = 33.63,  but  this  is  clearly  not  a 
meaningful  descriptor  of  this  highly  oscilla- 
tory queue. 

88 

b.  The  M/M/1  queue  with  pareuneters  X®=iT_X='2g,  and 

110 

ti‘*=Trti=~‘^,  has  a stationary  mean  queue  length 
of  4,  with  a variance  of  20.  It  does  not  begin 
to  offer  an  approximation  to  the  present  queue. 

c.  The  parameters  chosen  for  the  numerical  example 
can  be  thought  of  as  representing  a short  over- 
saturated rush  hour  (Phase  1) , a transitional 
period  (Phases  2 and  3)  and  an  unsaturated  period 
(Phases  4 through  8) , repeated  cyclically.  The 
conditional  queue  length  distributions  at  the 
ends  of  Phases  1,3  and  8 represent  the  most 
"extreme"  queue  conditions.  By  mixing  the  con- 
ditional queue  length  densities  of  the  Phases  4, 
5,..., 8 with  the  weights  tt  ^ (11^+. . .+irg)  4iji8, 
we  obtain  the  conditional  queue  length  density, 
given  that  the  queue  is  in  its  unsaturated  period. 
This  density  will  clearly  be  different  from  that 


at  the  end  of  Phase  8. 
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d.  Although  the  mean  queue  lengths  vary  consider- 
ably between  phases  1 and  8,  there  is  much  less 
variation  in  the  standard  deviations.  This  is 
^ due  to  two  causes . During  the  oversaturated 

I 

phase  there  is  enormous  random  variability  in  the 

i 

‘ behavior  of  the  queue.  Very  long  queues  at  the 

I end  of  a rush  hour  will  take  a long  time  to  dis- 

f 

I sipate,  while  shorter  queues  dissipate  quickly. 

I This  effect  is  likely  to  become  apparent  in  high 

variances  in  spite  of  reduced  means  in  the  higher 
phases . 

The  second  cause  of  the  high  variability  in  those 
phases  lies  in  the  exponential  distribution  of 
the  sojourn  times  in  each  phase.  The  effect  of 

L 

I this  assumption  is  easy  to  study.  By  modifying 

the  Q-matrix,  we  can  change  the  distributions  of 
the  rush  hour,  the  trcuisition  period  and  the 
undersaturated  period  in  a versatile  manner  with- 
out cheuiging  their  mean  durations.  These  periods 
can  have  arbitrary  phase  type  distributions, 
f which  may  have  arbitrary  positive  coefficients  of 

I variation. 

I In  order  to  illustrate  the  latter  points  numerically  we  com- 

I puted  a number  of  parametric  variants  of  this  model.  The 

[ results  will  be  presented  only  briefly,  but  they  are  striking 

indeed . 
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Variemt  1 


) 


We  replace  the  exponential  duration  of  the  rush-hour 


by  an  Erlang  distribution  of  order  2 with  pareuneter  2.  This 
does  not  affect  the  mean  duration  of  the  rush-hour  period, 
but  reduces  its  variance.  The  inner  products  and  Tryi 
remain  as  before.  There  are  now  nine  phases. 


Tcdile  4 ; Conditional  Means  and  Variances  in  the 
Various  Phases 


Phase 

Mean 

Variance 

0 

26.69 

801.99 

1 

41.70 

1051.32 

2 

41.87 

1077.30 

3 

32.03 

1061.05 

4 

26.34 

985.76 

5 

21.53 

883.98 

6 

17.53 

771.76 

7 

14.24 

660.04 

8 

11.54 

555.57 

Phases  0 and  1 now  correspond  to  the  rush-hour.  We  note  the 
drastic  reduction  in  the  means  and  variances  in  all  the 


phases.  The  dependence  on  the  random  variaibility  of  the 
duration  of  the  rush-hour  period  is  very  strong  indeed. 


Variant  2 

In  this  case  we  increased  the  service  rate  during  the 
transitional  period,  keeping  iry  constant  by  reducing  the  ser- 
vice rate  later  in  the  under saturated  case.  The  parameters 
are  as  in  the  original  model,  except  for  ^ which  is  now 
(10,  7,  7,  3,  3,  3,  1,  1).  The  effect  of  this  change  in 
parcimeters  is  not  as  substantial  as  one  might  expect. 
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Table  5;  Conditional  Means  and  Variances  in 
the  Various  Phases 


Phase  Mean 


1 54.56 

2 47.94 

3 34.95 

4 30.49 

5 26.60 

6 23.21 

7 23.98 

8 24.51 

1 

[ Variant  3 

The  most  striking  improvement  in  the  conditions  of 
the  queue  is  obtained  by  increasing  the  service  rate  during 
the  rush  period  itself.  This  is,  of  course,  not  always 
economically  feasible. 

The  parameters  are  again  as  in  the  original  model, 
except  for  \i_  which  is  now  (30,  5,  5,  2,  2,  2,  2,  2). 


Variance 

2775.76 

2734.02 

2442.26 

2258.57 

2067.01 

1875.74 

1846.81 

1828.46 


Table  6;  Conditional  Means  and  Variances  in 
the  Various  Phases 


Phase 

Mean 

Variance 

1 

15.75 

251.15 

2 

16.66 

260.63 

3 

10.13 

214.98 

4 

8.49 

187.23 

5 

7.12 

161.06 

6 

5.99 

137.07 

7 

5.07 

115.67 

8 

4.31 

97.01 

final  comment 

is  concerned 

with  the  relationship 

between  the  means  and  corresponding  standard  deviations  in 
all  the  preceding  exeunples.  We  see  that  queues,  which 
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periodically  pass  through  phases  in  which  they  are  locally 
oversaturated , exhibit  considerable  random  variation.  To 
obtain  reliable  parameter  estimates  by  Monte  Carlo  simula- 
tion, with  the  rather  small  S2unple  sizes  employed  in  prac-  i 

! 

tice,  appears  to  be  impossible.  The  numerical  behavior  of  ' | 

I 

the  present  exaunples  casts  serious  doubt  on  the  merits  of  \ 

i 

i 

simulation  methods,  when  applied  to  realistic  queueing  | 

models,  unless  prohibitively  large  sample  sizes  are  used.  | 
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